Latest Updates
Useful content we haven’t had time to organize yet
Latest Updates
5% of new Wikipedia content is AI-generated, according to an Oct 2024 studyusing AI detection software. Much of the new content comes from language translation.
David Gilmore calculates the “thought-hours” of humans and AI to conclude that humans run at about 10k tokens/hour but AI is improving rapidly so the total 2 T tokens/year generated by humans will be overtaken by computers by 2035 or sooner.
The Future of Content in an AI-generated World
Deaddit is a parody of Reddit: LLMs talking to one another in an all-AI generated Reddit-style site.
Situational Awareness argument that super-intelligence is near.
Ethan Mollick in Financial Times (May 19, 2024) writes that managers need to “rethink” the nature of their work, but doesn’t offer specifics. Like many of these overviews about AI’s impact on business, he quotes from various surveys that show how people are using LLMs but doesn’t look critically at the likelihood that in the excitement of being asked about new technology, people often exaggerate. Aside from meeting summarization and artwork, my own experience is that very little of what we see in LLMs is truly transforming companies.
Read cautiously those results that claim AI does better than humans. As Ethan Mollick notes:
Take the fact that the AI scores in the 90th percentile in the Bar Exam. A new paper examining this score in more detail finds a number of problems with how the AI is compared to humans, and ultimately concludes that, with the right prompting, GPT-4 would be in the 69th percentile overall (not the 90th) and is in the 48th percentile of students who pass the exam. Still a very good grade, and one that passes the Bar, but not quite as good as reported. And tests remain a limited measure, as passing the Bar does not make you a good lawyer.
Wondering about the future limitations of AI? see What AI Can_t Do
Computing Power and Data Needed for AI updates on how much data is required.
“Slop” is the term for unwanted AI-generated content. Similar to “spam” for email.
WSJ on AI generated populations and the kinds of simulations that can be done, e.g. clinical trials.
Henry Farrell explains why ChatGPT is an engine of cultural transmission, with numerous quotes and summaries from UC Berkeley Psychology Professor Alison Gopnik
Gopnik and her co-authors speculate that LLMs might similarly make the transmission of information more “efficient,” greatly enhancing discovery.
AI can be an aid to observability?: recognizing normal and abnormal activity and then interpreting and summarizing log data and making suggestions for resolving problems.
AI can be used to baseline data sets and detect anomalies. In this use case, AI algorithms can recognize normal activity across different timeframes — from months to weeks, even down to individual days — and flag when an abnormality crops up.
April 2
Robin is a company? example of using AI to scrape thousands of school websites and generate summaries of, say, how many schools have a policy for X.
Benchmarking LLMs against human expert-curated biomedical knowledge graphs.
Generative AI to quantify uncertainty in weather forecasting.
Cognition Labs and Devin for software engineering
Ethan Mollick got it to work for hire on Reddit.
2024-03-11 Scott Alexander proposes a series of prompts that can participate in a prediction market.
2024-03-06
My thoughts about Sora GPT Applications - Images and Video
AI in Healthcare: Personal Science Tips
2024-02-28
Other
AWS has a Hugging Face Page that includes Amazon Sagemaker integrations with Mistral and more.